Joint intent detection and slot filling with wheel-graph attention networks
نویسندگان
چکیده
Intent detection and slot filling are recognized as two very important tasks in a spoken language understanding (SLU) system. In order to model these at the same time, many joint models based on deep neural networks have been proposed recently archived excellent results. addition, graph network has made good achievements field of vision. Therefore, we combine advantages propose new with wheel-graph attention (Wheel-GAT), which is able interrelated connections directly for single intent filling. To construct structure utterances, create nodes, directed edges. nodes can provide utterance-level semantic information filling, while also local keyword detection. The promote each other carry out end-to-end training time. Experiments show that our approach superior multiple baselines ATIS SNIPS datasets. Besides, demonstrate using bi-directional encoder representation from transformer (BERT) further boosts performance SLU task.
منابع مشابه
Joint Intent Detection and Slot Filling Using Convolutional Neural Networks
We describe a joint model for intent detection and slot filling based on convolutional neural networks (CNN). The proposed architecture can be perceived as a neural network (NN) version of the triangular CRF model (TriCRF), which exploits the dependency between intents and slots, and models them simultaneously. Our slot filling component is a globally normalized CRF style model (as opposed to l...
متن کاملAttention-Based Recurrent Neural Network Models for Joint Intent Detection and Slot Filling
Attention-based encoder-decoder neural network models have recently shown promising results in machine translation and speech recognition. In this work, we propose an attention-based neural network model for joint intent detection and slot filling, both of which are critical steps for many speech understanding and dialog systems. Unlike in machine translation and speech recognition, alignment i...
متن کاملA Joint Model of Intent Determination and Slot Filling for Spoken Language Understanding
Two major tasks in spoken language understanding (SLU) are intent determination (ID) and slot filling (SF). Recurrent neural networks (RNNs) have been proved effective in SF, while there is no prior work using RNNs in ID. Based on the idea that the intent and semantic slots of a sentence are correlative, we propose a joint model for both tasks. Gated recurrent unit (GRU) is used to learn the re...
متن کاملPosition-aware Attention and Supervised Data Improve Slot Filling
Organized relational knowledge in the form of “knowledge graphs” is important for many applications. However, the ability to populate knowledge bases with facts automatically extracted from documents has improved frustratingly slowly. This paper simultaneously addresses two issues that have held back prior work. We first propose an effective new model, which combines an LSTM sequence model with...
متن کاملUnsupervised Person Slot Filling based on Graph Mining
Slot filling aims to extract the values (slot fillers) of specific attributes (slots types) for a given entity (query) from a largescale corpus. Slot filling remains very challenging over the past seven years. We propose a simple yet effective unsupervised approach to extract slot fillers based on the following two observations: (1) a trigger is usually a salient node relative to the query and ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Intelligent and Fuzzy Systems
سال: 2022
ISSN: ['1875-8967', '1064-1246']
DOI: https://doi.org/10.3233/jifs-211674